User interface system

ABSTRACT

The user interface system of the preferred embodiment includes: a layer defining a surface, a substrate supporting the layer and at least partially defining a cavity, a displacement device coupled to the cavity and adapted to expand the cavity thereby deforming a particular region of the surface, a touch sensor coupled to the substrate and adapted to sense a user touch proximate the particular region of the surface, and a display coupled to the substrate and adapted to output images to the user. The user interface system of the preferred embodiments has been specifically designed to be incorporated into an electronic device, such as the display of a mobile phone, but may be incorporated in any suitable device that interfaces with a user in both a visual and tactile manner.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of prior U.S. application Ser. No.12/319,334, filed on 5 Jan. 2009 and entitled “User Interface System,”and which is incorporated in its entirety by this reference.

This application is a continuation-in-part of prior U.S. applicationSer. No. 11/969,848, filed on 4 Jan. 2008 and entitled “System andMethod for Raised Touch Screens,” and which is incorporated in itsentirety by this reference.

TECHNICAL FIELD

This invention relates generally to touch sensitive displays. Moreparticularly, this invention relates to systems and methods forselectively raising portions of touch sensitive displays.

BACKGROUND

Touch sensitive displays, e.g., touch screens, are very useful inapplications where a user can input commands and data directly on adisplay. Common applications for touch screens include consumer productssuch as cellular telephones and user interfaces for industrial processcontrol. Depending on their specific applications, these touch sensitivedisplays are commonly used in devices ranging from small handheld PDAs,to medium sized tablet computers, to large pieces of industrialequipment.

It is often convenient to be able to input and output data to and fromthe user on the same display. Unlike a dedicated input device such as akeypad with discrete well-defined keys, most touch sensitive displaysare generally flat. As a result, touch sensitive screens do not provideany tactile guidance for one or more control “buttons”. Instead, touchsensitive displays rely on visual guidance for user input.

Hence a serious drawback of touch sensitive displays is its inherentdifficulty to input data accurately because adjacent buttons are notdistinguishable by feel. Wrongly entered key strokes are common and theuser is forced to keep his or her eyes on the display. The importance oftactile guidance is readily apparent in the competition between theApple iPhone and the BlackBerry 8800. With a limited size, the mobilephones prior to this invention could include either a large screen ortactile buttons. With this invention, mobile phones and other suitableelectronic devices can include both.

BRIEF DESCRIPTION OF THE FIGURES

FIG. 1 is a top view of the user interface system of a preferredembodiment.

FIG. 2 is a cross-sectional view illustrating the operation of a buttonarray in accordance to the preferred embodiments.

FIGS. 3 a and 3 b are cross-sectional views of the layer, the substrate,the cavity, the touch sensor, and the display of the preferredembodiments, with the cavity in a retracted volume setting and anexpanded volume setting, respectively.

FIGS. 4 a and 4 b are cross-sectional views of the touch sensor locatedabove the substrate, with the cavity in a retracted volume setting andan expanded volume setting, respectively.

FIGS. 5 a and 5 b are cross-sectional views of the layer and thesubstrate combined as a singular structure, with the cavity in aretracted volume setting and an expanded volume setting, respectively.

FIGS. 6 a and 6 b are cross-sectional views of a support member betweenthe layer and the substrate, with the cavity in a retracted volumesetting and an expanded volume setting, respectively.

FIG. 6 c is a top view of the support member.

FIG. 6 d is a cross-sectional view of an alternative support member thatpartially defines the cavity.

FIGS. 7 a and 7 b are cross-sectional views of the layer, the substrate,the cavity, the touch sensor, the display, and a displacement devicethat modifies the existing fluid in the cavity, with the cavity in aretracted volume setting and an expanded volume setting, respectively.

FIG. 8 is a schematic view of the layer, the substrate, the cavity, thetouch sensor, the display, and a displacement device of a first examplethat displaces additional fluid into the cavity.

FIG. 9 is a schematic view of the layer, the substrate, the cavity, thetouch sensor, the display, and a displacement device of a second examplethat displaces additional fluid into the cavity.

FIGS. 10 a and 10 b are schematic views of the layer, the substrate, thecavity, the touch sensor, the display, and a displacement device of athird example that displaces additional fluid into and out of thecavity, with the cavity in a retracted volume setting and an expandedvolume setting, respectively.

FIGS. 11, 12, 13, 14, and 15 are top and side views of a buttondeformation, a slider deformation, a slider ring deformation, a guidedeformation, and a pointing stick deformation, respectively.

FIG. 16 is a flow chart of the different operation modes of thepreferred embodiments.

FIG. 17 is a schematic of the different input graphics, different cavitysettings, and different user touches of the preferred embodiments.

FIGS. 18 a and 18 b are schematic views of the cavity and the secondcavity connected to a single displacement device, with the cavity in aretracted volume setting and an expanded volume setting, respectively.

FIGS. 19 a and 19 b are schematic views of the cavity and the secondcavity connected to a separate displacement devices, with the cavity ina retracted volume setting and an expanded volume setting, respectively.

FIGS. 20 a, 20 b, and 20 c are schematic views of the cavity and thesecond cavity connected to a linear actuator, with the cavity in theexpanded volume setting and the second cavity in the retracted volumesetting, the cavity and the second cavity in the retracted volumesetting, and the cavity in the retracted volume setting and the secondcavity in the expanded volume setting, respectively.

FIG. 21 a is a schematic view of a first cavity array arranged in a dialpad and a second cavity array arranged in a QWERTY keyboard on the samedevice.

FIGS. 21 b and 21 c are schematic views of the display of a dial padaligned with the first cavity array and a QWERTY keyboard aligned withthe second cavity array, respectively.

FIGS. 22A and 22B are schematic representations of one variation of theuser interface system.

FIGS. 23A and 23B are schematic representations of one variation of theuser interface system.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

The following description of the preferred embodiments of the inventionis not intended to limit the invention to these preferred embodiments,but rather to enable any person skilled in the art to make and use thisinvention.

As shown in FIGS. 1 and 2, the user interface system 100 of thepreferred embodiment includes: a layer 110 defining a surface 115, asubstrate 120 supporting the layer no and at least partially defining acavity 125, a displacement device 130 coupled to the cavity 125 andadapted to expand the cavity 125 thereby deforming a particular regionof the surface 115, a touch sensor 140 coupled to the substrate 120 andadapted to sense a user touch proximate the particular region of thesurface 115, and a display 150 coupled to the substrate 120 and adaptedto output images to the user.

The user interface system 100 of the preferred embodiments has beenspecifically designed to be incorporated into an electronic device, suchas the display of an automotive console, a desktop computer, a laptopcomputer, a tablet computer, a television, a radio, a desk phone, amobile phone, a PDA, a personal navigation device, a personal mediaplayer, a camera, or a watch. The user interface system may, however, beincorporated in any suitable device that interfaces with a user in botha visual and tactile manner.

1. The Layer and Substrate

As shown in FIG. 2, the layer 110 of the preferred embodiment functionsto provide the surface 115 that interfaces with a user in a tactilemanner. The surface 115 is preferably continuous, such that when swipinga finger across the surface 115 a user would not feel any interruptionsor seams. The surface 115 is also preferably planar. The surface 115 ispreferably arranged in a flat plane, but may alternatively be arrangedin a curved plane. The layer 110 also functions to deform upon anexpansion of the cavity 125, and to preferably “relaxes” or “un-deforms”back to a normal planar state upon retraction of the cavity 125. Thelayer no is preferably elastic. In one version, the layer 110 isrelatively more elastic in specific areas and relatively less elastic inother areas and is deformed in the relatively more elastic areas. Inanother version, the layer 110 is generally uniformly elastic. In yetanother version, the layer 110 includes or is made of a smart material,such as Nickel Titanium (commonly referred to as “Nitinol”), that has aselective and/or variable elasticity. The layer 110 is preferablyoptically transparent, but may alternatively be translucent or opaque.In addition to the transparency, the layer 110 preferably has thefollowing properties: a high transmission, a low haze, a wide viewingangle, a minimal amount of back reflectance upon the display 150 (if thedisplay 150 is coupled with the user interface), scratch resistant,chemical resistant, stain resistant, and relatively smooth (not tacky)to the touch. The layer 110 is preferably made from a suitable elasticmaterial, including polymers and silicon-based elastomers such aspoly-dimethylsiloxane (PDMS) or RTV Silicon (e.g., RTV Silicon 615). Thelayer 110 may, however, be made of any suitable material that providesthe surface 115 and that deforms. In one version, the layer 110 is asingle homogeneous layer less than 1 mm thick (preferably 50 to 200microns). In another version, the layer 110 may be constructed usingmultiple layers or coatings from the same material or from differentsuitable materials.

The substrate 120 of the preferred embodiments functions to support thelayer 110 and to at least partially define the cavity 125. In oneversion, as shown in FIGS. 3 a and 3 b, the layer 110 is directlyattached to the substrate 120 using an adhesive, ultra-sonic bonding,oxygen plasma surface treatment, or any other suitable techniques knownto one skilled in the art. The substrate 120 and the layer 110, in thisversion, cooperately define the cavity 125 (with the substrate 120defining a “container” and the layer 110 defining a “membrane” over the“container”). In another version, as shown in FIGS. 4 a and 4 b, thelayer 110 is indirectly attached to the substrate 120 with anotherelement, such as the touch sensor 140 and/or the display 150 locatedbetween the layer 110 and the substrate 120. The substrate 120 and theintervening element define the cavity 125 in this version. In yetanother version, as shown in FIGS. 5 a and 5 b, the layer 110 and thesubstrate 120 are formed as a singular structure, which fully definesthe cavity 125. In yet one more version, as shown in FIGS. 6 a and 6 b,the substrate 120 may include a lattice-like support member 160 underthe particular region of the surface 115. When the cavity 125 isexpanded and the deformation is present in the surface 115, the supportmember 160 functions to prevent a user from “pressing too far” into thedeformation below the plane of the surface 115. When the cavity 125 isnot expanded and the deformation is not present in the surface 115, thesupport member 160 functions to reduce (or potentially eliminate) theuser from feeling “divots” in the surface 115 when swiping a fingeracross the surface 115. As shown in FIG. 6 c, the support member 160preferably includes holes or channels that allow for the expansion ofthe cavity 125 and the deformation of the surface 115. The supportmember 160 is preferably integrally formed with the substrate 120, butmay alternatively be formed with the layer 110, as shown in FIGS. 22Aand 22B, or may be separately formed and later attached to the substrate120 as shown in FIGS. 23A and 23B. Finally, as shown in FIG. 6 d, thesupport member 160 may alternatively define the cavity 125. Thesubstrate 120 is preferably rigid, but may alternatively be flexible inone or more directions. The substrate 120—if located above the display150 is preferably optically transparent, but may—if located below thedisplay 150 or if bundled without a display 150—be translucent oropaque. The substrate 120 is preferably made from a material includingpolymers or glass, for example, elastomers, silicon-based organicpolymers such as poly-dimethylsiloxane (PDMS), thermoset plastics suchas polymethyl methacrylate (PMMA), and photocurable solvent resistantelastomers such as perfluropolyethers. The substrate 120 may, however,be made of any suitable material that supports the layer 110 and atleast defines the cavity 125. In the preferred version, the substrate120 is a single homogenous layer approximately 1mm to 0.1 mm thick andcan be manufactured using well-known techniques for micro-fluid arraysto create one or more cavities and/or micro channels. In alternativeversions, the substrate 120 may be constructed using multiple layersfrom the same material or from different suitable materials.

As shown in FIGS. 3 a and 3 b, the cavity 125 of the preferredembodiment functions to hold a fluid and to have at least two volumetricsettings: a retracted volume setting (shown in FIG. 3 a) and an extendedvolume setting (shown in FIG. 3 b). The fluid is preferably a liquid(such as water, glycerin, or ethylene glycol), but may alternatively bea gas (such as air, nitrogen, or argon) or any other substance (such asa gel or aerogel) that expands the cavity 125 and deforms the surface115. In the extended volume setting, the cavity 125 extends above theplane of the surface 115, thereby deforming a particular region of thesurface 115. As explained above, the cavity 125 is preferably defined bythe substrate 120 and the layer 110 (or an intervening element), or bythe substrate 120 and layer 110 as a singular structure, as shown inFIGS. 22A and 22B. In one version, as shown in

FIGS. 6 a and 6 b and as further explained below, the cavity 125 doesnot have any fluidic connection to any other elements of the userinterface system 100. The displacement device 130, in this version, maybe located within or adjacent to the cavity 125. In another version, thecavity 125 includes a fluidic connection via a channel to a (remotelylocated) displacement device 130. In both cases, the cavity 125 can beconsidered an “enclosed cavity” since the cavity 125 is preferably fluidtight (except for any fluidic connections to the displacement device130). When used with a mobile phone device, the cavity 125 preferablyhas a diameter of 2-10mm. When used with this or other applications,however, the cavity 125 may have any suitable dimension.

2. The Displacement Device

The displacement device 130 of the preferred embodiment functions tomodify the volume of the fluid thereby expanding the cavity 125 from theretracted volume setting to the extended volume setting and, ultimately,deforming a particular region of the surface 115. The displacementdevice 130 preferably modifies the volume of the fluid by (1) modifyingthe volume of the existing fluid in the cavity 125, or (2) adding andremoving fluid to and from the cavity 125. The displacement device 130may, however, modify the volume of the fluid by any suitable device ormethod. Modifying the volume of the existing fluid in the cavity 125most likely has an advantage of lesser complexity, while adding andremoving fluid to and from the cavity 125 most likely has an advantageof maintaining the deformation of the surface 115 without the need foradditional energy (if valves or other lockable mechanisms are used).When used with a mobile phone device, the displacement device 130preferably increases the volume of the fluid within the cavity 125 byapproximately 0.003-0.1 mL When used with this or other applications,however, the volume of the fluid may be increased (or possiblydecreased) by any suitable amount.

Modifying the existing fluid in the cavity 125 may be accomplished inseveral ways. In a first example, as shown in FIGS. 7 a and 7 b, thefluid may be an expandable fluid and the displacement device 130 mayinclude a heating element that heats the expandable fluid, therebyexpanding the volume of the existing fluid in the cavity 125 (accordingto the ideal gas law, PV=nRT). The heating element, which may be locatedwithin or adjacent the cavity 125, is preferably a resistive heater(made of a material such as TaN or Nichrome). In a second example, thefluid may include an expandable substance, such as plastic expandablemicrospheres. In a third example, the fluid may include paraffin. Whilethese are three examples, the displacement device 130 can be any othersuitable device or method that ultimately expands the cavity 125 fromthe retracted volume setting to the extended volume setting by modifyingthe existing fluid in the cavity 125.

Adding and removing fluid to and from the cavity 125 may also beaccomplished in several ways. In a first example, as shown in FIG. 8,the displacement device 130 includes a reservoir 132 to hold additionalfluid and a pump 134 to displace fluid from the reservoir 132 to thecavity 125. The reservoir 132 is preferably remote from the cavity 125(and connected by a channel 138 or other suitable device), but mayalternatively be located adjacent the cavity 125 and connected directlyto the cavity 125. A portion of the channel 138 is preferably amicro-fluidic channel (having cross-section dimensions in the range of 1micrometer to 1000 micrometers), but depending on the size and costsconstraints of the user interface system 100, the channel 138 may haveany suitable dimensions. The pump 134 is preferably a micro-pump (suchas pump #MDP2205 from ThinXXs Microtechnology AG of Zweibrucken, Germanyor pump #mp5 from Bartels Mikrotechnik GmbH of Dortmund, Germany), butmay be any suitable device to pump fluid from one location to another.The pump 134 is preferably located at a distance from the cavity 125,and is preferably connected to the cavity 125 by a channel 138. Toextend the cavity 125 from a retracted volume setting to the extendedvolume setting, the pump 134 displaces fluid from a reservoir 132,through the channel 138, and into the cavity 125. To retract the cavity125 from the extended volume setting to the retracted volume setting,the pump 134 preferably “vents” or pumps in a reverse direction from thecavity 125 to the reservoir 132. In a second example, as shown in FIG.9, the displacement device 130 includes a reservoir 132 to holdadditional fluid, a first pump 134 to displace fluid from the reservoir132 to the cavity 125, a second pump 136 to displace fluid from thecavity 125 to the reservoir 132, a first valve located between the firstpump 134 and the cavity 125, and a second valve located between thecavity 125 and the second pump 136. To extend the cavity 125 from theretracted volume setting to the extended volume setting, the first valveis opened, the second valve is closed, and the first pump 134 displacesfluid from the reservoir 132, through the channel 138, and into thecavity 125. To retract the cavity 125 from the extended position to theretracted position, the first valve is closed, the second valve isopened, and the second pump 136 displaces fluid from the cavity 125,through the channel 138, and into the reservoir 132. In other respects,the second example is similar to the first example above. The userinterface system 100 may omit the second pump 136 and simply retract thecavity 125 from the extended volume setting to the retracted volumesetting by opening the second valve and allowing the cavity 125 to ventor “drain” into the reservoir 132 (potentially assisted by theelasticity of the layer 110 returning to an un-deformed state). In athird example, as shown in FIGS. 10 a and 10 b, the displacement device130 includes an actuator, such as a linear actuator, that displacesfluid into and out of the cavity 125. To extend the cavity 125 from aretracted volume setting to the extended volume setting, as shown inFIG. 10 a, the linear actuator displaces fluid through the channel 138and into the cavity 125. To retract the cavity 125 from the extendedvolume setting to the retracted volume setting, as shown in FIG. 10 b,the linear actuator draws fluid in a reverse direction from the cavity125 to the reservoir 132. In other respects, the third example issimilar to the second example above. While these are three examples, thedisplacement device 130 can be any other suitable device or method thatultimately expands the cavity 125 from the retracted volume setting tothe extended volume setting by adding and removing fluid to and from thecavity 125.

Although the cause of the deformation of a particular region of thesurface 115 has been described as a modification of the volume of thefluid in the cavity 125, it is possible to describe the cause of thedeformation as an increase in the pressure below the surface 115relative to the pressure above the surface 115. When used with a mobilephone device, an increase of approximately 0.1-10.0 psi between thepressure below the layer no relative to the pressure above the layer no,is preferably enough to deform a particular region of the surface 115.When used with this or other applications, however, the modification ofthe pressure may be increased (or possibly decreased) by any suitableamount.

The deformation of the surface 115 functions to provide a tactilefeedback that signals the location of the particular region of thesurface 115. When used in conjunction with an input graphic on thedisplay 150, the deformation of the surface 115 preferably signals thelocation of an input on the touch sensor 140. The deformation preferablyacts as (1) a button that can be pressed by the user and that signalsthe location of a single input on the touch sensor 140 under the button,(2) a slider that can be pressed by the user and that signals thelocation of multiple inputs on the touch sensor 140 under the slider,(3) a guide that signals the location of multiple inputs on the touchsensor 140 adjacent the guide, and (4) a pointing stick that signals thelocation of multiple inputs on the touch sensor 140 under and adjacentthe pointing stick. The deformation may, however, act as any othersuitable device or method that signals the location of a particularregion of the surface 115. The button, as shown in FIG. 11, preferablyhas a dome-like shape, but may alternatively have a cylindrical-likeshape (with a flat top surface), a pyramid-like shape, a cube-like shape(with a flat top), or any other suitable button shape. The touch sensor140 preferably recognizes any user touch 145 into the button as a userinput. The slider, as shown in FIGS. 12 and 13, preferably has a ridgelike shape (shown in FIG. 12), but may alternatively have a ring likeshape (shown in FIG. 13), a plus-like shape, or any other suitableslider shape. The touch sensor 140 preferably recognizes user touches145 at different locations into the slider and distinguishes these usertouches as different user inputs. As an example, the slider with thering like shape may act like the “click wheel” of the Apple iPod (secondgeneration). The guide, as shown in FIG. 14, preferably has a doubleridge shape or a double ring shape. Unlike the button and the slider,which are meant to be pressed by the user, the guide is meant to signalthe location next to the area meant to be pressed by the user. The touchsensor 140 preferably recognizes user touches 145 at different locationsbetween the two ridges and distinguishes these user touches as differentuser inputs. In another version, the guide may omit the second ridge.The pointing stick, like the button, preferably has a dome-like shape,as shown in FIG. 15, but may alternatively have a cylindrical-like shape(with a flat top surface), a pyramid-like shape, a cube-like shape (witha flat top), or any other suitable button shape. The pointing stick ismeant to signal the location under and adjacent the area meant to bepressed by the user. The touch sensor 140 preferably recognizes usertouches 145 at different locations under and around the pointing stickand distinguishes these user touches as different user inputs. As anexample, the point stick may act like the pointing stick trademarked byIBM as the TRACKPOINT and by Synaptics as the TOUCHSTYK (which are bothinformally known as the “nipple”).

3. The Touch Sensor and the Display

The touch sensor 140 of the preferred embodiments functions to sense auser touch proximate the particular region of the surface 115. The touchsensor 140 is preferably located under the substrate 120 (as shown inFIGS. 3 a and 3 b), but may alternatively be located above the substrate120 (as shown in FIGS. 4 a and 4 b). If located above the substrate 120,in addition to sensing a user touch, the touch sensor 140 also functionsto deform upon an expansion of the cavity 125 and therefore the touchsensor 140 preferably has elastic properties similar to the layer 110.As a variation of this version, the touch sensor 140 may act as thelayer 110 to partially define the cavity 125. The touch sensor 140preferably senses a user touch in a continuous or multiple step manner.For example, the touch sensor 140 preferably distinguishes a restinguser touch (that does not significantly modify the deformation of thesurface 115), a gentle user touch (that partially pushes the surface 115back to the normal, unexpanded plane of the surface 115), and a harduser touch (that completely pushes the surface 115 back to the normal,unexpanded plane of the surface 115). In other words, the touch sensor140 preferably senses different “heights” of the deformation. The touchsensor 140 may, however, simply sense a user touch in a binary manner(“on” or “off”). In one example, the touch sensor 140 is preferably aconventional capacitance-based touch sensor, such as the touch panelsold by Synaptics under the trademark CLEARPAD, but may be any suitabledevice that senses a user touch. The capacitance-based touch sensorpreferably senses a user touch based on the change in capacitancebetween two locations within or near the cavity 125. In another example,the touch sensor 140 is a pressure sensor either located in or coupledto the cavity 125. The pressure sensor preferably senses a user touchbased on a change in the pressure within the cavity 125 caused by a usertouch on the deformation of the surface 115. In yet another example, thetouch sensor 140 is integrated with the displacement device 130 to senseeither a fluid displacement or a pressure change caused by a user touchon the deformation of the surface 115. While these are three examples,the touch sensor 140 can be any other suitable device or method thatsenses a user touch proximate the deformation of the surface 115.

The display 150 of the preferred embodiments functions to interface witha user in a visual manner. The display 150 is preferably a conventionalliquid crystal display (LCD), but may alternatively any suitable devicethat displays an output. In one version, as shown in FIGS. 3 a and 3 b,the display 150 is located under the substrate 120. In another version,the touch sensor 140 and the display 150 may be integrated as a singlestructure that both senses a user input and displays an output. Forexample, an LCD with embedded optical sensors both touch screen andscanner functions was announced in a 2007 press release by SharpElectronics of Japan. This combined touch sensor/display—if flexible—maybe located above the substrate 120, and—if not flexible—may be locatedbelow the substrate 120. If the display 150 is located below thesubstrate 120 and the fluid, then the substrate 120 and the fluid arepreferably transparent and are preferably chosen to have substantiallysimilar (if not identical) refractive indexes. An example of a substrate120 and fluid that have substantially similar refractive indexesinclude: PMMA (which has an index of refraction of 1.489) and theCargille Laboratories Series A fluids (which cover the range of1.460-1.640) or a mixture of Diethyl Phthalate and water. When used inmobile phones, “substantially similar” in this context preferably means+/−0.1 relative to each other. When used in this and other applications,“substantially similar” may alternatively mean similar enough to preventviewing distortions of the display 150. The display 150 preferablyoutputs several different visual outputs. One of the outputs ispreferably an input graphic that is aligned with the particular regionof the surface 115 that can be deformed by the cavity 125 in theextended volume setting. Examples of suitable input graphics includeindividual letters of a QWERTY keyboard, individual numbers in a dialpad, and different locations on a map.

4. The Processor

The user interface system 100 of the preferred embodiment also includesa processor, which is coupled to the displacement device 130 and to thetouch sensor 140. As shown in FIG. 16, the processor functions tooperate the user interface system 100 in an Extended Cavity Mode and aRetracted Cavity Mode. In the Extended Cavity Mode, if the particularregion of the surface 115 is deformed, then a user touch that furthersignificantly deforms the particular region of the surface 115 ispreferably recognized as a user input of a first type. A user touch thatdoes not significantly deform the particular region of the surface 115,such as the touch of a user resting their fingers on the deformation, ispreferably not recognized as a user input of the first type (and ispreferably ignored). In this manner, the deformation of the surface 115additionally functions to distance the user touch from the touch sensor140 and to allow the user to rest their fingers on the deformation (thelocation of an input) without actuating the input. The question ofwhether a user has significantly or not significantly deformed theparticular region of the surface 115 may be set or modified by themanufacturer, by the processor, or by the user. In the Retracted CavityMode, if the particular region of the surface 115 is not deformed, thena user touch at the particular region in the surface 115 is preferablynot recognized as a user input of the first type, but rather isrecognized as a user input of a second type that is distinguishable froma user input of the first type.

The processor may also function to automatically alter the settings ofthe user interface system 100. In a first example, in extremely lowtemperatures, it may be impossible for the displacement device 130 tomodify the volume of the fluid to expand the cavity 125 and deform thesurface 115. The processor may be coupled to a temperature sensor andmay disable the displacement device 130 under such conditions. In asecond example, in high altitude conditions (or in an airplane withreduced air pressure), it may be impossible for the displacement device130 to modify the volume of the fluid to retract the cavity 125. Theprocessor may be coupled to a pressure sensor and may either disable thedisplacement device 130 (or close particular valves), or may simplyadjust the volume of the fluid that is modified under such conditions.

As shown in FIG. 17, the processor may also be coupled to the display150 such that different input graphics may be displayed under the samedeformation of the surface 115, and different inputs may be recognized.As an example, when the cavity 125 is in the extended volume setting,the display 150 may include an input graphic of a first type (such as aletter) and the user input on the deformation would be of a first type(such as a letter), and the display 150 may include an input graphic ofa second type (such as a number) and the user input on the deformationwould be of a second type (such as a number). When the cavity 125 is inthe retracted volume setting, the display 150 may further include aninput graphic of a third type (such as an “enter” or “accept” input),and the user input on the touch sensor 140 would be of a third type(such as an “enter” or “accept” input).

The processor may also function to alter the output of the display 150to correct or adjust for any optical distortion caused by thedeformation in the surface 115. It is envisioned that, in certainapplications, the size of the deformation may cause a “fish eye” effectwhen viewing the display 150. The processor, preferably throughempirical data, may adjust the output to help correct for thisdistortion.

The processor preferably includes a separate and remote controller forthe displacement device 130, a separate and remote controller for thetouch sensor 140, and a separate and remote controller for the display150. The processor may, however, integrally include a controller for oneor more of these elements.

5. Second Cavity

As shown in FIGS. 1 and 2, the user interface system 100 of thepreferred embodiment also includes a second cavity 225. The additionalcavities, except as detailed below, are preferably identical to thecavity 125. In one version, as shown in FIGS. 18 a and 18 b, thedisplacement device 130 is connected to both the cavity 125 and thesecond cavity 225 and is adapted to expand the cavity 125 and the secondcavity 225 together, acting together as an array, thereby deforming morethan one region of the surface 115 at the same time. In a secondversion, the user interface system 100 includes a valve located betweenthe displacement device 130 and the cavity 125 and another valve locatedbetween the displacement device 130 and the second cavity 225 toselectively control the fluid flow into the cavity 125 and into thesecond cavity 225, respectively. In a third version, as shown in FIGS.19 a and 19 b, the user interface system 100 includes a seconddisplacement device 230 connected to the second cavity 225, whichfunctions to expand the second cavity 225 and thereby deforming a secondregion of the surface 115. The second displacement device 230 isotherwise similar or identical to the displacement device 130. Byseparately controlling the displacement device 130 and the seconddisplacement device 23 o, the cavity 125 and the second cavity 225 maybe expanded independently. In a fourth version, as shown in FIGS. 20 a,20 b, and 20 c, the displacement device 130 is a linear actuator thatcan either expand the cavity 125 and retract the second cavity 225(shown in FIG. 20 a), retract the cavity 125 and the second cavity 225(shown in FIG. 20 b), or retract the cavity 125 and expand the secondcavity 225 (shown in FIG. 20 c). This arrangement may be particularlyuseful in large arrays of cavities, as shown in FIG. 21 a, where thecavities aligned with a dial pad can be expanded (as shown in FIG. 21 b)or the cavities aligned with a QWERTY keyboard can be expanded (as shownin FIG. 21 c).

6. Power Source

The user interface system 100 of the preferred embodiments also includeseither a power source or a power harnessing device, which both functionto power the displacement device 130 (and possibly other elements of theuser interface system, such as the touch sensor 140 and/or the display150). The power source is preferably a conventional battery, but may beany suitable device or method that provides power to the displacementdevice 130. The power-harnessing device, which is preferably integratedinto the hinge of a flip phone or laptop, functions to harness a portionof the energy involved in the normal use of the electronic device (suchas the opening of a flip phone or the screen on a laptop). Thepower-harnessing device may alternatively be integrated in a separatemechanical input device (such as a button on the side of a mobile phone,or a “self-winding” device found in automatic watches) or any othersuitable device or method to harness a portion of the energy involved inthe normal use of the electronic device.

7. Alternative Embodiments

The user interface system of an alternative embodiment of the inventionomits the display 150. The user interface system of the alternativeembodiment is otherwise similar or identical to the user interfacesystem 100 of the preferred embodiment. The user interface system of thealternative embodiment can be incorporated into electronic devices thatdo not typically include a display, such as peripheral for an electronicdevice. Suitable peripherals include a mouse, a trackpad, a keyboard,and a remote control. These peripherals are often used only by touch,and not by sight. The user interface system may, however, beincorporated in any suitable device.

As a person skilled in the art of user interfaces will recognize fromthe previous detailed description and from the figures and claims,modifications and changes can be made to the preferred embodiments ofthe invention without departing from the scope of this invention definedin the following claims.

We claim:
 1. A user interface comprising: a layer comprising a singularstructure defining a cavity, a fluid channel, and a tactile surface, thetactile surface defining a deformable region adjacent the cavity and aperipheral region adjacent the deformable region, the tactile surfacecontinuous over the deformable region and the peripheral region, thefluid channel configured to communicate fluid in a directionsubstantially parallel to the tactile surface at the peripheral region;a support member extending into the cavity and configured to support thedeformable region against inward deformation, the support memberdefining a lattice structure comprising a set of fluid conduitsconfigured to fluidly couple the fluid channel to the cavity; adisplacement device configured to transition the deformable regionalbetween a retracted setting and expanded setting by displacing fluidthrough the fluid channel and into the cavity via the set of fluidconduits, the tactile surface at the deformable region flush with thetactile surface at the peripheral region in the retracted setting, thetactile surface at the deformable region offset from the tactile surfaceat the peripheral region in the expanded setting; and a sensor coupledto the layer and configured to detect an input on the tactile surface.2. The user interface of claim 1, wherein the support member isintegrally formed with the layer.
 3. The user interface of claim 1,further comprising a substrate coupled to the layer opposite the tactilesurface and cooperating with the layer to define the fluid channel andthe cavity.
 4. The user interface of claim 3, wherein the layer isrelatively elastic and wherein the substrate is relatively rigid.
 5. Theuser interface of claim 1, wherein, in the expanded setting, the tactilesurface at the deformable region is elevated above the tactile surfaceat the peripheral region.
 6. The user interface of claim 5, wherein, inthe expanded setting, the tactile surface at the deformable regiondefines one of: a button, a ridge, a ring, a slider, a pointing stick,and a guide.
 7. The user interface of claim 1, wherein an interior faceof the layer opposite the tactile surface is in contact with the supportmember in the retracted setting, the interior face of the layerpartially defining the cavity.
 8. The user interface of claim 7,wherein, in the expanded setting, the interior face is lifted off of thesupport member.
 9. The user interface of claim 1, wherein each fluidconduit in the set of fluid conduits defines a substantially circularcross-section of a diameter approximating a thickness of the layer atthe deformable region.
 10. The user interface of claim 1, furthercomprising a reservoir coupled to the displacement device and configuredto contain fluid.
 11. The user interface of claim 1, wherein the sensorcomprises a capacitive touch sensor.
 12. The user interface of claim 1,wherein the sensor is coupled to the layer opposite the tactile surface.13. The user interface of claim 1, further comprising a display coupledto the layer and configured to visually output an image through thetactile surface.
 14. The user interface of claim 13, wherein the displayis configured to output the image that comprises an input keysubstantially aligned with the deformable region.
 15. The user interfaceof claim 1, wherein the displacement device comprises a pump.
 16. Theuser interface of claim 1, wherein the displacement device is furtherconfigured to displace fluid out of the cavity to transition thedeformable region from the expanded setting to the retracted setting.17. The user interface of claim 1, further comprising a processorcoupled to the sensor and configured to interpret an input on thetactile surface as one of an input of a first input type responsive tothe deformable region in the retracted setting and an input of a secondinput type responsive to the deformable region in the expanded setting.18. The user interface of claim 1, wherein the layer further defines asecond cavity and a second fluid channel configured to communicate fluidinto the second cavity, wherein the tactile surface further defines asecond deformable region adjacent the second cavity, and wherein thedisplacement device is further configured to transition the seconddeformable region between a retracted setting and an expanded setting bydisplacing fluid through the second fluid channel and into the secondcavity.
 19. The user interface of claim 18, wherein the displacementdevice is configured to selectively transition the deformable region andthe second deformable region between the retracted and expandedsettings.
 20. The user interface of claim 1 incorporated into a deviceselected from the group consisting of: an automotive console, a desktopcomputer, a laptop computer, a tablet computer, a television, a radio, adesk phone, a mobile phone, a PDA, a personal navigation device, apersonal media player, a camera, and a watch.
 21. The user interface ofclaim 1, wherein the layer defines the cavity that is circular incross-section, and wherein the support member defines the latticestructure that comprises four fluid conduits arranged substantiallyequiangular about a radial center of the cavity.